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Abstract 

Let S be the von Neumann entropy of a finite ensemble £ of pure quantum states. 
We show that S may be naturaUy viewed as a function of a set of geometrical volumes 
in Hilbert space defined by the states and that S is monotonically increasing in each 
of these variables. Since S is the Schumacher compression limit of £, this monotonicity 
property suggests a geometrical interpretation of the quantum redundancy involved in the 
compression process. It provides clarification of previous work in which it was shown that 
S may be increased while increasing the overlap of each pair of states in the ensemble. 
As a byproduct, our mathematical techniques also provide a new interpretation of the 
subentropy of £. 



1 Introduction 

One of the most satisfying results of quantum information theory is Schumacher's source 
coding theorem ^ |21 El 11113 ) which says that a message of length K from a source of pure 
quantum states with density matrix p can be compresssed to KS{p) qubits (asymptotically 
for large K), where S{p) is the von Neumann entropy 

S{p) = -Tr{p\ogp). 

Conceptually we can associate the possibility of compression with the presence of a degree of 
redundancy in the source. Suppose pi, p2 are the density matrices of two sources and 

S{pi) < S{p2). (1) 

Then the first source can be compressed further than the second, so it has greater redundancy. 
If the two sources both have k states, \ipi) and \(pi), say, with the same probabilities pi, then 
this increased redundancy does not lie in the classical probabilities pi of emitting the states 
but in the properties of the states themselves: it is true "quantum redundancy" . Intuitively, 
one expects that, if the states are more similar than the states \(pi), then the quantum 
redundancy will be greater. So if the pairwise overlaps of the {ipi) are larger than those of 
the {(pi), i.e. 

\ >\{(l>i\(l>j)\ for alH,j, (2) 

then pi should have more quantum redundancy than p2, and consequently should hold. 
Jozsa and Schlienz jB] showed this is indeed true for a source with two states. However, 



they produced a counter-example consisting of a set of three states, in three dimensions 
and a shght perturbation of them, {ipi), that has greater overlaps but larger entropy. This 
phenomenon raises the question of whether compression and quantum redundancy can be 
understood in geometrical terms, i.e. in terms of the geometry of the source's states in Hilbert 
space. This question has also been recently raised in Q. In this paper we will establish a 
connection between quantum redundancy and the volumes in Hilbert space defined by the 
source states. 

One reason the above example appears paradoxical is that, in real three-dimensional 
geometry, the pairwise inner products of three unit vectors determine the figure the vectors 
make, up to an orthogonal transformation, and they also determine the entropy in this real- 
valued setting. An analogous result holds in complex geometry if the complex inner product 
is specified, but not if only its absolute value, the overlap, is given. In fact, taking into 
account the freedom in specifying phase for a quantum mechanical state, it turns out that 
there are four real- valued degrees of freedom in specifying three states in three dimensions up 
to a unitary transformation (as will be shown shortly). Specifying the three pairwise overlaps 
I (V'i|^2) I, I (V'llV'a) I and I {iJ2\fp3) I therefore leaves a further degree of freedom that can be 
used to adjust the entropy. 

What is this extra degree of freedom for three states in three (complex) dimensions? 
Here it is useful to introduce the Gram matrix G, with entries Gij = ^JPiPj and 
the matrix A with entries aij = G has the same eigenvalues as the density matrix 

p = ^Pi\'4'i) (V'il (see ini) so the von Neumann entropy 

S{p) = - ^XilogXi (3) 

can be computed from the eigenvalues Xj of the Gram matrix 

/ Piflii V^iP2ai2 V^lP3«13 

G = V^2Pr«21 P2a22 V^2P3«23 
V V^3Pr«31 V^3P2a32 ^3033 

G has the characteristic equation 

— six^ + S2X — S3 = 0, (4) 

where the Sj are the symmetric polynomial functions of the eigenvalues, with si = ^ Xj = 1, 
S2 = J2i<j XiXj and S3 = X1X2X3. Expanding det(G — Ix) one finds that 

S2 = ^PiPjil - laijl"^) and S3 = P1P2P3 det A. (5) 

i<j 

Since A can be written as ^4 = BB"^, where B is the matrix 

tp21 tp22 ■023 
, V'Sl tp32 1p33 . 

of coordinates tf^ij of the states |0j) in any orthonormal basis, it follows that det A = \ det Sp, 
and we can regard det A as the squared modulus of the complex volume spanned by the 
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Note also that (1 — |ajjp) = detAij, where Aij is the submatrix of A obtained by striking out 
rows and columns having labels not in the set Thus we can likewise regard 1 — |ajjp 

as the squared modulus of the complex volume spanned by and We can write the 
terms of eq © that depend on the states as 

ai2 = det^i^2) «13 = det Ai^3, 023 = det^2,3 and 0123 = det^ (6) 

and S2 and S3 then appear as positive linear combinations of these volume variables. Thus 
S{p) is determined by the probabilities pi and the four squared volumes in If the states 
are perturbed in such a way that three of these four parameters are fixed but one of them 
varies, then the entropy changes as intuition would dictate: increasing A12 (i.e. decreasing 
the overlap between states 1 and 2) increases the entropy (decreases the redundancy), and 
increasing the volume (i.e. spreading the states apart) also increases the entropy. In this sense 
we can regard the four parameters 012, ais, 023 > 0123 > as measures of quantum redundancy for 
the set of states. This behaviour of the entropy follows from a theorem proved later, which 
tells us that dS/dsi > for i >2. Consequently when none of the pi is zero (which we shall 
assume throughout), dS/doij = piPjdS/ds2 > and dS/dai23 = PiP2P3dS/ds3 > 0. 

2 k states in n dimensions 

We now investigate the situation for any number k of states which span a space of n dimen- 
sions (so k > n). We can try to imitate in n dimensions the procedure that gave the variables 
in ®. Let the states be with probabilities pi for i = 1, . . . ,k. As above we introduce the 
Gram matrix with entries Gij = ^JPiPj and the A-matrix with entries aij = (ipilipj), 

both being kx k matrices. The eigenvalues of the Gram matrix are those of the nxn density 
matrix p padded out with k — n zeros jH. Thus the characteristic equation det(G — xl) = 
for the Gram matrix for k states in n dimensions has the form 

n 

(_l)'=-V-"^(-l)*s„_,x* = 0, (7) 

where Si is the i-th elementary symmetric polynomial of the eigenvalues of the 

density matrix, defined by 

So = 1, Si= Xui--- for i = 1, . . . , n. (8) 

Ul<...<Ui 

The ith symmetric polynomial may be expressed as 

Si — ^ ^ Pui ■ • • PuiOiui,...,Uii (9) 

Ul<...<Ui 

where aui,...,Ui = det^uj^...^„;, and ^ui,...,^^ is the sub-matrix of the matrix A obtained by 
striking out all rows and columns with labels not in the set {ui, . . . , Ui}; i.e. ^ui,...,^^ is the ixi 
jd-matrix constructed from the subset {\il^ui) , ■ ■ ■ , iV'ni)} of the states. This follows because Sj 
is the coefficient of {—x)^^^ in det{G — xl), which is obtained by picking k — i elements on the 
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diagonal, corresponding to rows vi, . . . , Vk-i say, and for each such choice of v's, constructing 
the determinant of the sub-matrix Gui,...,ui of G where ui, . . . ,Ui is the complementary set 
to the v^s. Since the Gram matrix G is related to the corresponding ^-matrix by G = QAQ, 
where Q = diag(^/^, . . . , ^/^), we get det Gui,...,^. = .. .pu^ detAu^,. Eq © is then 
obtained by summing over all sets of u's. 

Note that, though the individual entries in Aui,...,^; are dependent on a choice of phase for 
the states Om, is invariant under phase choices. Furthermore, aui,...,^^ is real, since 
■^ui,...,Ui is Hermitian. Thus aui,...,^^ is a real-valued unitary invariant, and the complete set 
of all aui,...,«, for all sets ui, . . . ,Ui can be regarded as the analogues of the invariants © in 
the case k = n = 3. Also, as in the case of = n = 3, = Bui,...,UiB^-^ where 

Bui,...,Ui is the i X i matrix whose rows are the components of the i states \ipui) , ■ ■ ■ , l^uj 
(expanded in any choice of orthonormal basis in the span of these i states). Thus 0^1,..., niay 
be identified as the squared modulus of the complex volume determined by \ipui) ■ ■ , iV'^i)- 

Let xi, . . . , x„ be any probability distribution and let Si = Si{xi, . . . , Xn) for i = 1, . . . , n be 
the corresponding symmetric polynomials. For any function f{xi, . . . (e.g. the entropy 
S) we consider a change of variables from the Xj's to the Sj's. Note that the probability 
condition = 1 corresponds to si = 1, and lifting this condition we get n variables in 
each case. Then the Jacobian is readily seen to be Yli^j{xi — Xj), so the change of variables is 
valid if the Xj's are all different. For simplicity we will work within this restriction but expect 
that our results will have suitable (finite) limiting behaviour for coincident values Xi xj. 
Furthermore we will be interested primarily in partial derivatives df/dsi for i > 2 (which 
have si held constant), so our results will also remain valid if we impose the probability 
constraint si = 1 = constant at the start. 

We have the following fundamental property of the entropy: 

Theorem 1 If S = —J2^i log Xi is viewed as a function of the symmetric polynomials 
si, . . . ,Sn then dS/dsq > for q = 2, . . . ,n. 

Two proofs of this theorem are given in the appendix. 

3 Geometrical interpretation of quantum redundancy 

Eq @ gives an expression for the symmetric polynomials Si that is canonically determined 
by the state set {iV^i) , ■ ■ ■ , iV'fc)} and probabilities pi, ■ ■ ■ ,Pk- Thus from S = S{si, . . . , Sn) 
(with si = 1) we can view the von Neumann entropy of the source in a natural way as being 
a function of the probabilities and all the squared volumes ai^ij, . . . , ctiii2...ik- theorem^ 
dS/dsq > for g > 2 and by eq ©, each Sq is a positive linear combination of the a-variables, 
so we conclude that dS/da > for each squared volume variable a. 

This suggests a geometrical interpretation of the quantum redundancy in the ensemble 
of quantum states. If the probabilities are held fixed and the states are deformed then the 
change in entropy can be seen as an accumulation of monotonic effects arising from the 
changes induced in each of the squared volumes a. Since dS/da > the set of these squared 
volumes can be regarded as a geometric measure of the quantum redundancy associated to a 
set of states alone. 
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Note however that, for A; > 3, there are more a's than degrees of freedom needed to fix 
k states up to overall unitary equivalence. Indeed, let v{k,n) denote the number of degrees 
of freedom in specifying k states in n dimensions up to unitary transformation. To specify k 
states requires k{2n — 2) real parameters (as each state is defined only up to overall phase). 
The unitary group U{n) has v? parameters, but because of the overall phase freedom in 
each state, U and e^^U have the same action for any x. Thus, unitary action on the states 
eliminates — 1 parameters from the k{2n — 2), giving u{k,n) = k{2n — 2) — (n^ — 1). 

The following table shows iy{k, n) for small values of k and n and k > n. The bracketed 
numbers are the total number T{k,n) of terms aui,...,ui, ignoring those with i > n, which are 
zero since more than n states must be linearly dependent and therefore have zero determinant. 
The numbers in brackets are therefore T{k,n) = EL2 (i)- 

Table 



k 


n = 2 


n = 3 


n = 4 n = 5 


2 


1(1) 






3 


3(3) 


4(4) 




4 


5(6) 


8 (10) 


9(11) 


5 


7(10) 


12 (20) 


15 (25) 16 (26) 



For k < 3 the two sets of numbers agree, so the a's can be used to parametrize the sets 
of states. For A; > 3 there are always too many a's. Thus viewing the entropy iS as a 
function of the r(fc,n) a's (for fixed probabilities) amounts to a non-trivial extension of S 
to a larger space of variables: not every r(fc, n)-tuplc of a-values is geometrically realisable 
by an ensemble of k states in n dimensions, and when an actual ensemble is deformed, the 
a- variables are constrained to lie on a surface of dimension u{k,n) in the ambient space of 
dimension r(A;, n). But the virtue of this non-physical extension of the number of parameters 
is that we are able to attribute compressibility of the source to geometrical constructs, viz. 
the a's. In any deformation of actual states, each a varies positively or negatively and the 
compressibility varies by a corresponding accumulation of monotonic positive and negative 
effects. 

4 Minimal sets of monotonic parameters? 

Since r(/c, n) > v{k, n) for A; > 3, it is interesting to ask whether we can find some alternative 
set of parameters, . . . ,Py(^k.n) which is in 1-1 correspondence with the set of k states and 
has some of the desirable properties possessed by the a's in the case /c < 3. In particular, 
to make a connection with the phenomenon of compression, we would like the monotonicity 
property dS/dPi > to hold for any choice of probabilities pi. Intuitively, this means that 
we can regard the /?'s as measures of quantum entropy. 

Consider the case k = n = A. Here the set of states is 9 dimensional, whereas there are 
11 a's. Can we perhaps keep some of the a's, taking, say, the overlap-related terms a^j as 
Pi,. . . Pq, and adding a further 3 /3's? (For instance, one might consider adding the 3 distances 
between subspaces generated by disjoint pairs of the four states, i.e. (i(12,34), d(13, 24) and 
d(14, 23), where d{ij,kl) is some measure of the distance between the subspace spanned by 
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Itpi), {tpj) and that spanned by {ipk), However, it turns out that any set of parameters 

that includes the 6 terms aij cannot have the desired monotonicity property. To see this, 
write rij = \aij\ and define u = arg(ai2a2303i)! v = arg(ai4a2ia42), and w = arg(ai3a34a4i). 
Then we can write all the a's in terms of the 6 rj^ 's and u, v and w, giving 9 parameters in 
all. For instance, ai23 = 1 — — ?^23 ~ ''ii + 2ri2r23r3i cos u. 

Now pick one of the Pi for i > 6, and call it x. Taking the partial derivative with respect 
to X, the fact that .../?6 are constant implies ds2/dx = (since by eq © S2 is a function 
only of /?!, . . . tPg)- Furthermore, if we choose a set of states with r^j > for all i,j and 
u = V = w = TT /2 we find 

dss/dx = -2{pip2P3){ri2r23r3i)u^ - 2{pip2P4){n4,r2ir42)vx 

-2{piP3Pi){ri3r34,r4i)Wx + 2{p2P3P4:)ir23r3Ari2)iUx +Vx + Wx). 

Suppose the first three terms in the above expression for 833/ dx are positive. Since . . . , /Je 
are real and positive, this means Ux < 0, Vx < 0, Wx < 0. So the fourth term is negative. By 
taking pi small enough, we can ensure that 833/ dx < and also that 834,/ dx is sufficiently 
small to ensure that the term with g = 3 dominates the sum dS/dx = J2i9S/d3q){d3q/dx). 
So dS/dx < and monotonicity fails. Suppose on the other hand that at least one of the 
first three terms is negative, the term with Ux say, so Ux > 0. Then taking p4 small enough 
leads to the same conclusion. 

This result suggests that it may be difficult to construct a minimal set of i^{k, n) monotonic 
parameters which also has a simple geometrical interpretation, thus further underlining the 
benefits of considering the non-minimal parameter set in section |31 



5 A remark on subentropy 

It is curious that our proof of the theorem that the entropy is an increasing function of 
the symmetric functions 3q (Appendix) depends upon an algebraic expression closely related 
to a quantity called the subentropy. Given any density matrix p, the subentropy Q{p) (HI 
is the greatest lower bound on the accessible information of any ensemble of pure states 
|(/>i) , . . . , \(t>m) with probabilities pi, . . . ,pm, for which p = J2Pi \4'i) {4'i\- terms of the 
eigenvalues xi, . . . , x„ of p (or indeed for any classical probability distribution) the subentropy 
can be written ^ ^ 

which is closely related to our eq pfij) : i.e. we would wish to put g = in that formula! 

Looking at the derivation of eq (fTO)) (c.f. especially eq <\l2\i ) we see that the value q = 
would correspond to a coefficient, cq say, of x" in the characteristic equation and then dS/dco 
would be essentially the subentropy. Thus let us divide through eq (|TT|) by si, introducing 
new variables 

1 S2 3n 

ti = — , t2 = — , ... ,tn = 

Si Si Si 
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and look at 

p{x) = ^^p{x) = tix"-x"-i + ... + (-l)%x"-'' + ... + (-l)"t„ 

= j^{x - Xl) . . .{X - Xn). 

Viewing this equation as defining Xi = Xi{ti, . . . , tn) and carrying out an implicit differentia- 
tion with respect to ti we get 

dxk _ x^si 
dh Ylk^iixk - Xi) 

and 

^ (l + logXfc)xg 

Finally using the identity (valid for any xi, . . . , x„) 

^ ff (ru r ) =Xl + ---+Xn = Si 

we get 

^ = .i(.i-Q). 

If xi, . . . ,Xn is a probability distribution, so si = 1, then we get dS/dti = 1 — Q. Thus we 
have proved: 

Theorem 2 Let S = —^2^1 log Shannon entropy function defined on {(xi, . . . , x„) : 

Xj > all i} (i.e. we lift the probability condition ^ Xi = 1). If S is viewed as a function of 
ti = 1/ si, t2 = S2/ si, ... , tn = Sn/si then at points with si = J2 = ^ subentropy is 
given by Q{xi, . . . , x„) = 1 — dS/dti. 

Note that the above mathematical characterisation of subentropy applies equally well within 
c/assica/information theory (as it is a derivative property of the Shannon entropy function), in 
contrast to all previous work on subentropy |H1 EI where it relates only to quantum mechanical 
considerations (especially the theory of information gain from quantum measurements). 

Finally we also note that there are other possible ways of getting a nontrivial coefficient 
of x" in eq For example instead of dividing through by si we could divide through by 
Sn and introduce the variables 

= -^^—3- = symmetric polynomial of 1/xi, . . . , l/x„. 

We then get the equation 

^p{x) = r„x" + ... + (-l)V„_gx"-^ + ... + (-!)- 
= (x/xi - 1) . . . (x/x„ - 1) = 

leading to an alternative characterisation of subentropy Q as 

^ = M^i-Q) 

and the condition for xi, . . . , x„ to be a probability distribution is now s\ = r^-xlr^ = 1, i.e. 
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6 Discussion 



The problem we have addressed in this paper is whether there are real-valued functions aq of 
k states in n dimensions that together characterize those states up to a unitary transformation 
and are also "measures of quantum redundancy" in the sense that dS/doq > for each a^. 
In other words, increasing one a while holding the others fixed increases the entropy S and 
hence reduces the redundancy of the set of states. We would also like the aq to have an 
interpretation in terms of the Hilbert space geometry of the states. 

We use the term "quantum redundancy" here because we require that dS/daq > holds 
for any choice of probabilities pi of the states and the pi can be thought of as embodying 
the classical aspect of redundancy. Of course, one might ask whether there are joint functions 
of the states and their probabilities that characterize the entropy, and one example of this 
is the "perimeter" considered recently by Hartley and Vedral ,1L . The question then is 
why one such function should be preferred to another; after all, the symmetric functions 
Sq trivially determine the entropy via the characteristic equation Q. The functions in jllj 
are motivated by the possibility of experimental measurement whereas our considerations 
are motivated by a desire to geometrically characterise a notion of quantum redundancy in 
quantum information compression. 

Our main conclusion is that there is a natural set of measures (in our sense) for sets of two 
or three states, but for four or more states the corresponding parameters - the determinants 
of square submatrices of the matrix ({ipilipj)) - outnumber the degrees of freedom in the 
sets of states, and the more obvious ways of carrying over the results from two or three 
states fail. Nevertheless the simple geometrical interpretation of these parameters, in terms 
of Hilbert space volumes defined by the states, makes it appealing to consider an extension 
of the entropy function to the full space of these variables, and the entropy of any physical 
ensemble of states then appears as a special case satisfying some extra algebraic constraint 
equations. 
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7 Appendix: proof of theorem [1] 

We give here two proof of the theorem that dS/dsq > for 2 < q < n. 
First proof 

We will prove a slightly stronger result, giving a positive lower bound for dS/dsq (see eq 



Recall that 



n 




i=l 
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where the Xi are roots of the characteristic equation Q 

n 

Pix) = Y.i-lr-'Sn^^x' = 0. 



(11) 



1=0 



Viewing this equation as imphcitly defining Xi = Xj(si, . . . , s„) and differentiating it with 
respect to Sq, we get 

dxk 
dsn 



E(-ir 



+ f-n^xr" = 0. 



(12) 



Since the expression in square brackets is the derivative of Y\{x — Xi) with x set to x^, we 
have 

dxk _ i-ir+'x^-'^ 

lYxom. the chain rule, for any function / of the Sq, 

ds„ ^ 



~l dSq 



(13) 



Taking f = si we get 



n—q 



k=l nj^fcC^^A: — Xi 



if 2 < g < n. 



Then, taking f = S = —J2xk log Xk gives 



— = {-1)1 y" ^fc '^(1 + logXfc) 



which in view of eq (|14|) imphes 

dS 



dSn 



(-irE 



Xk ^logXfc 



for 2 < q < n. 



Y UiM^k-Xij 

{xk + a)"""? log(2;fc + a) 



(14) 



(15) 



(16) 



Define 

'^^ ^ ^ ? ^i^kiXk — Xi) 

SO Wg(0) = dS/dsq. Rewriting Wq{a) as 

M/g(a) = ( l)''a"~'? E ^ ^fc/Q)"~'^ log(l + ^k/a) 

k Hi^kixk — Xi) 

eq (|14p allows us to approximate Wq{a) for large a by the term in x^~^ in the expansion of 

(1 + Xk/a)"-i log(l + Xk/a), giving 

^5(0) ~ (-l)''ai~'2 X [ coefficient of x""'^ in (1 + x)"-« log(l + x) 





as a — > 00 for 2 < q < n. 
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Using eq (|14|) again we find 



da 

for 2 < g < n, and applying eq (|TH) to the set a, xi, . . . , x„ 

dWJa) 



''^^^''^--[n-,)W,,M, (17) 



da 

Using nfe=i(a + ^k) < (a + 1/n)" in the preceding equation, 

da 1 



l/X{{a + Xk). (18) 



Wn{x) > 



(o + l/n)" (x + l/n)"-i(n 



so 55/as„ = Ty„(0) > n"-V(n - 1). 
Eq ()17|) for (7 = n — 1 then imphes 



("OO 

= / Wn{a)da> 

J X 



da 



(n - l)(a + 1/n) 



n-l 



1 



(x + l/n)"-2(n - l)(n - 2)' 
so dS/dsn-1 = Wn{0) > n"'~^/(n — l)(n — 2). And continuing this way we find 



n 



n—q 



> —31-. (19) 

^\ q ) 

So all the partial derivatives are bounded away from zero, which proves the theorem. 
Second proof 

A second proof involves using a theorem from numerical analysis - the so-called Hermite- 
Gennochi theorem jlUj - to replace the explicit derivation above from eq ()16() onwards. (This 
theorem was also used in jS], end of appendix A). Thus we begin as above, deriving the 
expression in eq (|T^ for dS/dsq. 

Now if f{x) is any function whose values are known only at n points xi, . . . , then there 
is a unique polynomial of degree n— 1, the Lagrange interpolating polynomial, that agrees with 
the function at these points. The coefficient of is called the Newton divided difference of 
/ and has standard explicit formula f [xi) / Y{k^i{xk — Xi) ■ Thus eq (fTO)) states that dS/dsq 
is the Newton divided difference for the function /(x) = (— l)'^x"~'^ log x. Now the Hermite- 
Gennochi theorem asserts that the Newton divided difference is also given by the integral 
over the probability simplex {(pi, . . . : > 0, Pi = 1} of /^""^^(pixi + . . . PnXn) where 
is {n — derivative of /. Taking / to be (— l)'^x"~'^ logx it is straightforward to 
check that /(""^^(x) > for all < x < 1. Hence the integral over the probability simplex 
is positive and we get dS/dsq > 0. 
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